PICTURE ENCODING SYSTEM CONVERSION DEVICE 
AND ENCODING RATE CONVERSION DEVICE 



FIELD OF THE INVENTION 
[0001] 

This invention relates to a picture (or image) encoding 
system conversion device and encoding rate conversion device and, 
more particularly, to a device which performs rate control 
taking both the picture quality and time delay accompanying the 
conversion into account. 
[0002] 

BACKGROUND OF THE INVENTION 

In a digital picture (or image) communication system or a 
digital picture communication service, the technique of 
encoding the picture information to reduce the information 
volume to effect transmission and storage is used in 
transmitting and storing the picture information. As an 
encoding system for moving picture, internationally 
standardized by ITU-T (International Telecommunication Union), 
there are known an encoding system prescribed by H. 261 
Recommendations providing for standardization of transmitted 
pictures of visual telephone and video conference and H. 263 
Recommendations providing for standardization of pictures 
transmitted over a low bitrate network, such as PHS (Personal 
Handy-Phone System) . 




[0003] 

In the encoding system for moving pictures, 
internationally standardized by ISO (International 
Organization for Standardization), there is known MPEG (Motion 
Picture Experts Group) 1, as an encoding system for stored video 
images, while there are known MPEG-2 and MPEG4 as a universal 
encoding system and a low bit rate encoding system, 
respectively. 
[0004] 

The respective encoding systems used for moving picture 
compression are merely analogous to one another to the extent 
that these systems use the DCT (Discrete Cosine Transform), 
motion compensation prediction and Huffman codes in common, 
which constitutes only a part. However, bitstreams obtained on 
actual encoding differ from one system to another. 
[0005] 

So, if it is desired to interconnect a system employing a 
certain picture encoding system to another encoding system 
employing another encoding system, picture codes, once formed, 
need to be decoded into picture signals, which then need to be 
re-encoded as an input picture. 
[0006] 

For example, if the H. 261 bitstream is to be converted into 
that of H. 263 or MPEG 4, not having the in-loop fi Itering function, 
such as one provided in H. 261, it is necessary to decode the 



encoded bitstream into an input picture and to re-encode the 

resu I t i ng picture signals. 

[0007] 

On the other hand, if it is desired to convert a bitstream 
of H. 263 or MPEG4 into that of H. 261, it is necessary to decode 
the bitstream into a picture and to re-encode the resulting 
picture. This is because the maximum value of the motion vector 
of H. 263 or MPEG4 is larger than that of the motion vector of 
H . 2 61, while the motion vector of H. 261 merely has the vector 
merely of an integer precision. 
[0008] 

That is, for converting a picture encoding system into 
another appreciably different picture encoding system, it is 
necessary for transforming a bitstream to interconnect a decoder 
to an encoder, first to revert the input bitstream transiently 
into picture signals by a decoder, and then to re-encode the 
picture signals as an encoder input signal. 
[0009] 

For moving picture data, encoded in accordance with a 
certain encoding system, there is known an encoding rate 
converting system, as a method for realizing rate conversion 
between an input bitstream and an output bitstream. This rate 
conversion is carried out when the bandwidth of a transmission 
channel for the input bitstream differs from that of 
transmission channel for an output bitstream. 



. [0010] 

Fig. 10 shows an embodiment of a structure of a conventional 
picture encoding system converting device. Referring to Fig. 10, 
this picture encoding system converting device includes a buffer 
5 5 for storing a bitstream output from outside, a decoder 6 for 
decoding picture codes output from the buffer 5, an encoder 7 
for encoding picture signals output from the decoder 6 and 
another buffer 8 for storing picture codes output from the 
] 0 encoder 7 to output the picture codes to outside. 

Its 

§}) [0011] 

m The encoder 7 monitors the storage volume (occupied volume) 

in the buffer 8. This stored volume in the buffer is utilized 

^ for controlling the volume of the generated codes during 
encoding by the encoder 7. 

ft [0012] 

As this sort of the picture encoding system conversion 
device, there is proposed in e. g. , JP Patent Kokai J P-A-7- 1 0746 1 
a picture encoding system conversion device adapted for storing 
the hysteresis information of encoding parameters, such as 
20 motion vector or quantization step size etc., used in decoding, 
and referencing these encoding parameters to determine the 
encoding parameters to effect re-encoding. 
[0013] 

In e.g., JP Patent Kokai J P-A-7-288804, there is proposed, 
25 as a re-encoding device for picture signals in which it is 



possible to prevent picture quality deterioration resulting 
from re-encoding and to freely select the picture quality on 
re-encoding, a configuration in which the number of quantization 
bits is set in addition to the prediction mode, motion vector 
and the quantization step size, as encoding parameters obtained 
on decoding an input bitstream, to enable re-encoding with an 
opt i ona I data amount. 
[0014] 

In e.g., JP Patent Kokai J P-A-8-1 1 1 870, there are also 
proposed, as a method and apparatus for re-encoding the picture 
information in such a manner as to assure optimum picture qual ity 
even for a picture having encoding hysteresis, a method and 
apparatus in which re-encoding is achieved using the prediction 
mode, motion vector, quantization step size or periods or phase 
of picture types, as encoding parameters obtained on decoding 
the i nput b i ts t ream. 
[0015] 

In e.g., JP Patent Kokai J P-A-1 0-32830, there is proposed 
a device for re-encoding picture signals in which the 
quantization step size acquired on decoding an input bitstream 
is used to determine the quantization step size of an encoder 
to realize the re-encoding. 
[0016] 

Ine.g. , JP Patent Kokai J P-A-1 0-336672, there is proposed, 
in an encoding system conversion device in which, in re-encoding 



encoded picture data in accordance with a different encoding 
system, the processing volume is diminished without 
deteriorating the motion vector detection accuracy, a 
configuration in which the motion vector obtained in decoding 
5 encoded picture data is stored and scaled depending on the 
conversion scale of the picture size, or is converted in quantity 
depending on the number of frames, the so scaled or converted 
motion vectors are provided as candidates and one of these 

!;~ candidates is used to effect re-encoding. 

|o [0017] 

;]y In e.g. , JP Paten t Koka i JP-A-1 1-285002, there is proposed 

a moving picture encoding device in which quantization control 

j 3 ^ is performed on a bitstream obtained on encoding a moving picture 

|>i so that the bitrate of a bitstream acquired on re-encoding will 

F5 fall within a preset range. 
[0018] 

As another example of the encoding rate conversion device, 
there is proposed in e.g., JP Patent Kokai J P-A-8-25 1 587 a 
configuration of a rate conversion device for encoded picture 

20 data having a performance comparable to the transcoding using 
means simpler than the transcoding. In the above-described 
encoding rate converting device, disclosed in the JP Patent 
Kokai J P-A-8-251 587, there is proposed a configuration in which 
inverse-quantized encoded data is re-quantized to control the 

25 rate control of the quantization level. However, this 



conventional encoded picture data rate conversion device, 
described in the JP Patent Kokai J P-A-8-2 51 587, which decodes 
the received bitstream and uses the resulting encoding 
parameters to improve the picture quality on re-encoding, fails 
to take into account the delay time produced on effecting 
conversion of the encoding system. 
[001 9] 

SUMMARY OF THE DISCLOSURE 

Meanwhi I e, if the conversion of the picture encoding system 
is to be performed off-line, time delay caused in the encoding 
system conversion is not so problematic. 
[0020] 

However, in the picture encoding system conversion used in 
real-time communication, time delay caused in the encoding 
system conversion brings about a lowered service quality. 
[0021] 

On the other hand, the conventional encoding rate 
conversion device, while stating the method for determining the 
quantization step, fails to take the time delay into account. 
[0022] 

The above-described conventional devices suffer the 
following p rob I ems : 
[0023] 

As a first problem, in the conventional picture encoding 
system conversion device stated in the above-described JP 




. Patents Kokai JP-A-7-1 07461 , 7-288804. 8-111870, 1 0-336672 and 
10-32830, in which an input bitstream is decoded and the 
resulting encoding parameters are used for encoding to convert 
the encoding system, fails to take the time delay caused in 
5 converting the encoding system into account, thus occasionally 
causing marked transmission delay or lowering the encoding 
efficiency. 
[0024] 

?j That is, buffer delay caused in an output buffer owned by 

iitO the picture encoding system conversion device is not considered 
j || so that the problem of overflow or underflow in the output buffer 
:\. or the rate of the output bitstream is not taken into 
[TJ consideration, thus occasionally leading to a drastic 
i3 transmission delay or a significantly lowered encoding 
15 efficiency. 
[0025] 

As a second problem, the picture encoding system conversion 
device, described in the above-described JP Patent Kokai JP- 
A— 1 1 -285002, showing means for limiting the range of the 
20 bitrates of the output bitstream to within a preset range, fails 
to take the realtime conversion of the encoding system into 
consideration. 
[0026] 

That is, although the bitrate of the output bitstream is 
25 taken into consideration, no consideration is given to the delay 



etc. produced in the output buffer. 
[0027] 

As a third problem, although the conventional picture 
encoding system conversion device re-utilizes the encoding 
5 parameters produced on decoding the input bitstream, use of the 
information on the encoding quantity that can be grasped from 
the input bitstream is not taken into account. In short, when 

p the input bitstream is decoded, the encodingvolume of each frame, 

o 

j each GOB (gr oup-of -p i c t u res) and each macroblock can be grasped, 
i^l 0 however, such encoding volume cannot be utilized effectively, 
j [0028] 

With a simple encoder, it is possible to calculate an 
optimum volume of bit allocation to each frame from the band of 
the transmission channel for transmitting the bitstream and from 
15 the picture sampling interval. 
[0029] 

However, in the case of the picture encoding system 
conversion device, the picture fed to the encoder is a picture 
acquired on decoding the input bitstream, and is a picture having 
20 a diminished information volume. So, the picture quality 

cannot be expected to be improved appreciably even if the code 
volume to be allocated is increased, thus leading to an increased 
delay time. 
[0030] 

25 Conversely, ifthecodevolumetobeallocatedisdecreased, 



there may be an occurrence that the band of the transmission 

channel cannot be utilized effectively. 

[0031] 

So, it is necessary to make re-encoding using the 
5 information on the code volume as grasped from the input 

bitstream to take the picture quality, delay time and the band 
of the transmission channel into consideration to effect rate 
., 3 control. 
S [0032] 

iiHIO It is therefore an object according to an aspect of the 

=;2 present invention to provide a picture encoding system 
; ^ conversion device and an encoding rate conversion device in 
h L j which delay time increase or picture quality deterioration may 
□ be decreased. 
15 It is another object according to another aspect of the 

present invention to provide a novel picture encoding system 
conversion device and an encoding rate conversion device, which 
can make best use of the information on the code volume such as 
that of encoding parameters, input buffer, output buffer, input 
20 bitstream or the output bitstream, and in which picture encoding 
system conversion and code rate conversion can be realized 
taking realtime conversion into consideration. 

Further aspects and objects of the present invention will 
become apparent in the entire disclosure. 
25 [0033] 



According to a first aspect of the present invention, there 
is provided a picture encoding system conversion device 
including a decoder receiving picture codes, compressed in 
information volume, from a reception side transmission channel 
5 via an input buffer and expanding the received picture codes to 
output expanded picture codes, an encoder compressing the 
picture codes, decoded by the decoder, in information volume, 
to generate picture codes to output generated picture codes from 
: 1 an output buffer to a sending side transmission channel, and a 

a: ; 

JjjO transcoder control ler control I ing the encoder. The transcoder 

0 control ler includes an input buffer monitor monitoring the input 
buffer of the decoder, an output buffer monitor monitoring the 

" output buffer of the encoder and quantization step controller 
5 modifying (or changing) a quantization step in the compression 

1 5 processing of the encoder based on the information from the input 

buffer monitor and the output buffer monitor. 
[0034] 

In the picture encoding system conversion device according 
to the first aspect, the decoder includes a variable length 
20 decoder unit, and the transcoder controller further includes a 
decoder monitor monitoring the variable length decoder unit. 

The quantization step controller modifies the quantization 
step of the encoder based on the information from the input 
buffer monitor, the output buffer monitor and the decoder 
25 mon i to r. 



# • 



[0035] 

In the picture encoding system conversion device according 
to the first aspect, the transcoder controller includes a 
reception side transmission channel monitor monitoring the 
5 state of the receiving side transmission channel, and a sending 
side transmission channel monitor monitoring the state of the 
sending side transmission channel. The quantization step 
controller modifies the quantization step of the encoder based 
on the information from the input buffer monitor, output buffer 
irtl 0 monitor, reception side transmission channel monitor and the 
ffl sending side transmission channel monitor. 
[0036] 

In the picture encoding system conversion device, 
2 according to the present invention, the decoder includes a 

15 variable length decoding unit. The transcoder controller 
further includes a decoder monitor monitoring the variable 
length decoding unit, a reception side transmission channel 
monitor monitoring the state of the reception side transmission 
channel, and a sending side transmission channel monitor 

20 monitoring the state of the sending out side transmission 
channel. The quantization step controller modifies the 
quantization step of the encoder based on the information from 
the input buffer monitor, output buffer monitor, decoder monitor, 
reception side transmission channel monitor and the sending side 

2 5 transmission channel monitor. 




[0037] 

In another aspect, the present invention provides a code 
rate conversion device including a code rate conversion unit 
receiving picture codes compressed in information volume from 
a reception side transmission channel by an input buffer, 
converting the code rate of the picture codes and subsequently 
sendingout the resultant picture codes through an output buffer 
to a sending side transmission channel, and a transcoder 
controller controlling the code rate, wherein the transcoder 
control ler includes an input buffer monitor monitoring the input 
buffer, an output buffer monitor monitoring the output buffer 
and a quantization step controller modifying the quantization 
step in the compression processing of the code rate conversion 
unit based on the information from the input buffer monitor and 
from the output buffer monitor. 
[0038] 

In the code rate conversion device according to the present 
invention, the code rate conversion unit includes a variable 
length decoding unit. The transcoder controller includes a 
decoder monitor monitoring the variable length decoding unit. 

The quantization step control ler modifies the quantization 
step of the code rate conversion unit based on the information 
from the input buffer monitor, output buffer monitor and the 
decoder mon i tor. 
[0039] 
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In the code rate conversion device according to the present 
invention, the code rate conversion unit further includes a 
reception side transmission channel monitor monitoring the 
state of the reception side transmission channel and a sending 
side transmission channel monitor monitoring the state of the 
sending out side transmission channel. The quantization step 
controller modifies the quantization step of the code rate 
conversion unit based on the information from the input buffer 
monitor, output buffer monitor, reception side transmission 
channel monitor and the sending side transmission channel 



In the code rate conversion device according to the present 
invention, the code rate conversion unit includes a variable 
length decoding unit, and the transcoder controller includes a 
decoder monitor monitoring the variable length decoding unit, 
a reception transmission channel monitor monitoring the state 
of the reception side transmission channel and sending out 
transmission channel monitor monitoring the state of the sending 
out transmission channel. The quantization step controller 
modifies the quantization step of the code rate conversion unit 
based on the information from the input buffer monitor, output 
buffer monitor, decoder monitor, reception side transmission 
channel monitor and the sending out side transmission channel 
mon i to r. 



mon i to r. 



[0040] 



Further aspects and modes of the present invention will 
become apparent from the entire disclosure including the 
following description and the claims. The features of the 
appended claims are herein incorporated by reference thereto. 
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determining the quantization step. 

F i g. 1 0 shows the structure of a conventional picture 
25 encoding system conversion device. 



[0041] 

PREFERRED EMBODIMENTS OF THE INVENTION 

In the following, preferred embodiments of the present 
invention are explained. Referring to Fig. 1, a picture encoding 
5 system conversion device according to a first embodiment of the 
present invention includes a decoder 1 for receiving picture 
codes, compressed in information volume, from a reception side 
transmission channel via an input buffer 21 and for expanding 
0 the received picture codes to output expanded picture codes. An 
jl|D encoder 2 compresses the picture signals, decoded by said 
!Jq decoder, in information volume, to generate picture codes to 
J" output the generated picture codes from an output buffer 40 to 
\^ a sending out side transmission channel. A transcoder control ler 
j g 3 includes input buffer monitor 52 for monitoring said input 
ft buffer 21 of the decoder 1 and output buffer monitor 62 for 
monitoring the output buffer of the encoder 2. There is also 
provided a quantization step controller 71 for modifying the 
quantization step in the compression processing of the encoder 
2 based on the information from said input buffer monitor 52 and 
20 the output buffer monitor 62. 
[0042] 

Referring to Fig. 2, a code rate conversion device of a 
second embodiment of the present invention includes a decoder 
1 for receiving picture codes compressed in information volume 
25 from a reception side transmission channel by an input buffer 




21 and for subsequently sending out the decoded picture codes 
through an output buffer 40 to a sending out side transmission 
channel. A transcoder controller 3 includes a decoder monitor 

51 for monitoring the VLD unit 22 of the decoder 1, an input 
5 buffer monitor 52 for monitoring the input buffer 21 of the 

decoder 1, and an output buffer monitor 62 for monitoring the 
output buffer 40 of the encoder 3. There is also provided a 
quantization step controller 72 for modifying the quantization 
0 step in the compression processing of the code rate conversion 
139 unit based on the information from the input buffer monitor and 

from the output buffer monitor. 
T [0043] 

!•- Referring to Fig. 3, an encoding system conversion device 

!2 for converting a signal encoded in one encoding system into a 
H signal of another encoding system, according to a third 

embodiment of the present invention, includes a decoder 1 for 
receiving a compression-coded signal in an input buffer 21 to 
decode the signal in a variable length decoder 22 to output 
picture signals. An encoder 2 is fed with a signal output from 
20 the decoder 1 to compress the information to output the 

information to a sending out transmission channel via an output 
buffer 40. A transcoder controller 3 has an input buffer monitor 

52 for monitoring the input buffer 21 of the decoder 1, an output 
buffer monitor 62 for monitoring the output buffer 40 of the 

25 encoder 2, a reception transmission channel monitor 53 for 



* 



monitoring the state of the reception transmission channel and 
a sending out transmission channel monitor 63 for monitoring the 
state of the sending out transmission channel. There is also 
provided a quantization step controller 73 for variably 
5 controlling the quantization step in the quantizer 33 of the 
encoder 2 based on the information from the input buffer monitor 
52, output buffer monitor 62, reception transmission channel 
monitor 53 and the sending out transmission channel monitor 63. 



;fi for converting a signal encoded in one encoding system into a 
signal of another encoding system, according to a fourth 
embodiment of the present invention, includes a decoder 1 fed 

=;3 with a compression-coded signal in an input buffer 21 to decode 

1 j i the signal in a variable length decoding unit 22 to output the 
resulting picture signals. An encoder 2 is fed with a signal 
output from the decoder 1 to compress the information to output 
the information to a sending out transmission channel via an 
output buffer 40. A transcoder control ler 3 has a decoder monitor 

20 51 for monitoring the VLD unit 22 of the decoder 1, an input 
buffer monitor 52 for monitoring the input buffer 21 of the 
decoder 1, an output buffer monitor 62 for monitoring the output 
buffer 40 of the encoder 2, a reception transmission channel 
monitor 53 for monitoring the state of the reception 

25 transmission channel and a sending out transmission channel 



[0044] 



Ref er r i ng to 



F i g. 4, an encoding system conversion device 



# m 



monitor 63 for monitoring the state of the sending out 
transmission channel. There is also provided a quantization 
step controller 74 for variably controlling the quantization 
step in the quantizer 33 of the encoder 2 based on the information 
5 from the decoder monitor 51, input buffer monitor 52, output 
buffer monitor 62, reception transmission channel monitor 53 and 
the sending out transmission channel monitor 63. 
[00453 

: 3^ 

0 The decoder 1 includes an input buffer 21 fed with a signal 

14) from the reception side transmission channel, a VLD unit 22 for 
\-l decoding the encoded data from the input buffer 21, a first 

inverse quantizer (IQ) 23 for inverse quantizing the quantized 
u± transform coefficients from the VLD unit 22, an IDCT unit 24 fed 
j |3 with an output of the first inverse quantizer 23, a first adder 
1*5 25 fed at its one input with an output of the IDCT unit 24 and 
a first motion compensation prediction unit 27 fed with the 
encoding parameters from the VLD unit 22 and with the output of 
the VLD unit 22. The encoder 2 includes a second adder 31 fed 
with an output of the first adder 25, a DCT unit 32 for 
20 transforming an output of the second adder 31, a quantizer (Q) 
33 for quantizing an output of the DCT unit 32, a VLC 39 for 
encoding an output of the quantizer 33, an output buffer 40 fed 
with an output of the quantizer 33 to output to the sending out 
transmission channel, an inverse quantizer 34 for inverse 
25 quantizing an output of the quantizer 33, an IDCT unit 35 for 



transforming an output of the inverse quantizer 34, a third adder 
36 fed with an output of the IDCT unit 35 , a second frame memory 
unit 37 fed with an output of the third adder 36 and a second 
motion compensation prediction unit 38 fed with picture signals 
from the second frame memory unit 37 and with encoding parameters 
from the first motion compensation prediction unit 27. An 
output 203 from the second motion compensation prediction unit 
38 is fed to the VLC 39 and to the second adder 31, while being 
sent via a switch 41 to the third adder 36. The switch 41 is 
off and on for the l-picture (intra-coded picture) and for the 
P-picture (predictive picture) and for the b-picture 
(bidirectional predictive picture), respectively. The second 
adder 31 subtractsO from an output of the first adder 25 if the 
picture is an l-picture, while outputting a difference between 
the output the first adder 25 and the output of the second motion 
compensation prediction unit 38 if the picture is a P- or B- 
picture. 
[0046] 

Referring to Fig. 5, a code rate conversion device for 
converting a signal encoded in one encoding system into a signal 
of another encoding system according to a fifth embodiment of 
the present invention includes a code rate conversion unit 4 
including an input buffer 21 fed from a reception side 
transmission channel with a signal compressed in information 
volume, and configured for sending out the picture codes 



compressed in information volume from an output buffer 40 to a 
sending out side transmission channel, and a transcoder 
controller 3 including an input buffer monitor 52 for monitoring 
the input buffer 21, an output buffer monitor 62 for monitoring 
the output buffer 40, and a quantization step controller 71 for 
variably controlling the quantization step in the quantizer (Q) 
82 of the code rate conversion device 4 based on the information 
from the input buffer monitor 52 and the output buffer monitor 
62. 

[0047] 

Referring to Fig. 6, a code rate conversion device for 
converting a signal encoded in one encoding system into a signal 
of another encoding system according to a sixth embodiment of 
the present invention includes, in addition to the structure 
shown in the above-described fifth embodiment, a decoder monitor 
51 owned by the transcoder controller 3 for monitoring the VLD 
unit 22 of the code rate conversion device 4. The quantization 
step controller 72 variably controls the quantization step of 
the code rate conversion device 4 based on the information from 
the input buffer monitor 52, output buffer monitor 62 and the 
decoder mon i tor 51 . 
[0048] 

Referring to Fig. 7, a code rate conversion device for 
converting a signal encoded in one encoding system into a signal 
of another encoding system according to a seventh embodiment of 



22 



the present invention includes, in addition to the structure 
shown in the above-described fifth embodiment, a reception 
transmission channel monitor 53 for monitoring the state of the 
reception side transmission channel and a sending out 
transmission channel monitor 63 for monitoring owned by the 
transcoder controller 3 for monitoring the state of the sending 
out side transmission channel, with both monitors being owned 
by the transcoder controller 3. The quantization step 
controller 72 variably controls the quantization step of the 
code rate conversion device 4 based on the information from the 
input buffer monitor 52, output buffer monitor 62 and the decoder 
mon i t o r 5 1 . 
[0049] 

Referring to Fig. 8, a code rate conversion device for 
converting a signal encoded in one encoding system into a signal 
of another encoding system according to an eighth th embodiment 
of the present invention includes, in addition to the structure 
shown in the above-described fifth embodiment, a decoder monitor 
51 owned by the transcoder controller 3 for monitoring the VLD 
unit, a reception transmission channel monitor 53 for monitoring 
the state of the reception side transmission channel and a 
sending out transmission channel monitor 63 for monitoring the 
state of the sending out side transmission channel, with both 
monitors being owned by the transcoder controller 3. The 
quantization step controller 74 variably controls the 




quantization step (Q) of the code rate conversion device 4 based 
on the information from the input buffer monitor 52, output 
buffer monitor 62, decoder monitor 51, reception transmission 
channel monitor 53 and the sending out transmission channel 
5 monitor 63. 
[0050] 

In an preferred embodiment of the present invention, a 
picture code rate conversion device includes a code rate 
[0 conversion unit 4. The code rate conversion unit 4 includes an 
j^O input buffer unit 21 for being fed with a signal from a reception 
side transmission channel, a variable length decoding unit(VLD) 
i7 22 for decoding picture codes of said input buffer unit 21, a 
M first inverse quantizer (IQ) 23 for quantizing an output of the 
! 2 first variable length decoder 22, a first adder 81 on one input 
f5 end of which an output of the first inverse quantizer 23 is fed, 
a quantizer (Q) 82 for quantizing an output of the first a adder 
81, a variable length encoder (VLC) 83 for encoding an output 
of the quantizer 82 to output an encoded output, an output buffer 
40 fed with an encoded signal output of the variable length 
20 encoder 83 to output a resulting output to a sending out side 
transmission channel, a second inverse quantizer ( I Q) 84 for 
inverse quantizing an output of the quantizer (Q), a second adder 
85 for subtracting an output of the first adder 81 from an output 
of the second inverse quantizer 84, an IDCT unit 86 fed with an 
25 output of the second adder 85 as an input, a frame memory unit 



87 fed with and storing an output of the IDCT unit 86, a 
difference calculating unit 88 for taking a difference between 
the current picture output from said variable decoding unit 87 
and a picture one frame before from the frame memory unit 87 and 
5 a DCT unit 89 fed with an output of the difference calculating 
unit 88 as an input. The first adder 81 outputs a value 
corresponding to the output of the first inverse quantizer (IQ) 
23 minus the output of the DCT unit 89. The encoding parameters 
;Q output from the VLD unit 22 are input to the VLC 83. The 
j|0 quantization step controller 74 of the transcoder controller 3 
variably controls the quantization step of the quantizer (Q) 82. 
7 [0051 ] 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
;2 In the following, certain preferred embodiments of the 

: '?5 present invention are explained. Fig. 1 shows the structure of 
a first embodiment of the present invention. Referring to Fig. 1, 
the first embodiment of the present invention includes a decoder 
1, an encoder 2 and a transcoder controller 3. The decoder 1 
includes an input buffer 21, a variable length decoder (VLD) 22, 
20 an inverse quantizer ( I Q) 23, an inverse discrete cosine 

transform (IDCT) unit 24, an adder 25, a frame memory 26 and a 

motion compensation prediction unit 27. 

[0052] 

The encoder 2 includes an adder 31, a DCT (discrete cosine 
25 transform) u n i 1 3 2, a quantizer (Q) 33, an inverse quan t i zer (IQ) 



unit 34, an inverse discrete cosine transform (IDCT) unit 35, 
an adder 36, a frame memory unit 37, a motion compensation 
prediction unit 38, a variable length encoder (VLC) 39, and an 
output buffer 40. 
5 [0053] 

The transcoder controller 3 includes an input buffer 
monitor 52, an output buffer monitor 62, and a quantization step 
controller 71. 
Q [0054] 

lift 0 The decoder 1 and the encoder 2 decodes and encodes, 

[ 3 respectively, in accordance with pre-existing encoding systems, 

such as H. 261 , H. 263, or MPEG1, 2 or 4. 
Q [005 5] 

Referring to Fig. 1 , the operation of the first embodiment 
15 of the present invention is explained in detail. First, the 
operation of the decoder 1 is explained. 
[0056] 

The input buffer 21 stores a bitstream fed from an external 
transmission channel to output a stored bitstream to the VLD 22, 
20 while outputting the information 101 stored in the input buffer 
to the input buffer monitor 52. 
[0057] 

The VLD unit 22 entropy-decodes the output bitstream from 
the input buffer 21, such as by variable length decoding or 
25 run-length decoding, to output the decoded quantized transform 



coefficients to the IQ unit 23. On the other hand, the VLD 22 
outputs encoding parameters 201, such as motion vector or the 
prediction mode, to the motion compensation prediction unit 27. 
[0058] 

5 The IQ unit 23 inverse-quantizes quantized transform 

coefficients, output from the VLD unit 22, to output the 
inverse-quantized transform coefficients to the IDCT unit 24. 
„ [005 9] 

Q The IDCT unit 24 performs matrix calculations of inverse 

UH10 discrete transform on the transform coefficients output from the 
! 2 IQ unit 23 to output the transformed picture signals to the adder 

II* 25. 
y [0060] 

:3 The adder 25 sums a signal from the IDCT unit 24 and a 

15 picture signal output from the motion compensation prediction 
unit 27 as later explained to output a sum signal to the frame 
memory 26 and to an adder 31 of the encoder 2. 
[0061 ] 

The frame memory 26 saves the picture signals output from 
20 the adder 25. 
[0062] 

The motion compensation prediction unit 27 performs motion 
compensation prediction, using the encoding parameters 201 
output from the VLD unit 22 and the picture signals stored in 
25 the frame memory 26, to output the resulting picture signals to 



the adder 25. 
[0063] 

On the other hand, encoding parameters 202 are output to 
the motion compensation prediction unit 38 of the encoder 2. 
5 [0064] 

The operation of the encoder 2 is now explained. 
[0065] 

^ If the picture is a P- or B-picture, the adder 31 outputs 

I] picture signals corresponding to the sum of the picture signals 
Jo output from the adder 25 and a prediction signal output from the 
j ^fl motion compensation prediction unit 38, whereas, if the picture 
:^ is an I -picture, the adder 31 directly outputs picture signals 
j'j output from the adder 25. 
q [0066] 

15 The OCT unit 32 executes DCT matrix calculations 

(processing) on input picture signals to output the transform 

coefficients to the quantizer (Q) 33. 

[0067] 

The quantizer 33 performs quantization calculations on 
20 transform coefficients output from the DCT unit 32 to output the 
resulting quantized transform coefficients to the VLC unit 39 
and to the inverse quantizer 34. 
[0068] 

It is noted that quantization characteristics are 
25 determined by the quantization step information 103 output from 




the quantization step controller 71. 
[0069] 

The inverse-quantizer (IQ) 34 inverse-quantizes quantized 
transform coefficients output from the quantizer (Q) 33 to 
5 output the resulting transform coefficients to the IDCT unit 35. 
[0070] 

The IDCT unit 35 performs IDCT matrix calculations on the 
transform coefficients output from the inverse-quantizer 34 to 
;G output picture signals corresponding to predicted error signals 
IKO and those corresponding to the encoded picture signals to the 
adder 36 in case of the P- and B-pictures and in case of the 
I -p i c t u re, respect i ve I y. 
j-* [0071 ] 

j 2 The adder 36 outputs a signal corresponding to a sum of the 

'¥B picture signals output from the IDCT unit 35 and the predicted 

error signals in case of P- and B-pictures, whereas outputting 

the picture signals unchanged to the frame memory unit 37 in case 

of l-p i cture. 

[0072] 

20 The frame memory unit 37 stores the picture signals output 

from the adder 36. 
[0073] 

Using the encoding parameters 202 output from the motion 
compensation prediction unit 27 and the picture signals saved 
25 i.n the frame memory 37, the motion compensation prediction unit 




38 performs motion detection and motion compensation prediction 
to generate motion compensated prediction picture signals which 
are output to the adders 31 and 36. The encoding parameters 203 
are also output to the VLC unit 39. 
5 [0074] 

The VLC unit 39 applies entropy encoding, such as VLC or 
run-length coding, to the quantized transform coefficients 
output from the quantizer 33 and the encoding parameters 203 
l p z output from the motion compensation prediction unit 38 to output 
;K0 the resulting encoded signals to the output buffer 40. 
S [0075] 

The output buffer 40 stores the encoded signals output from 
j ! * the VLC unit 39 to send the encoded signals to outside the 

apparatus. 
T5 [0076] 

The operation of the transcoder controller 3 is now 
explained. 
[0077] 

The input buffer monitor 52 monitors the storage volume in 
20 the input buffer 21 of the decoder 1 to output the input buffer 
information 107 to the quantization step controller 71. 
[0078] 

The output buffer monitor 62 monitors the stored output 
buffer volume of the output buffer 40 in the encoder 2 to output 
25 the output buffer information 109 to the quantization step 




con t ro I I er 71 . 
[0079] 

Based on the input buffer information 107 and on the output 
buffer information 109, the quantization step controller 71 of 
5 the transcoder controller 3 determines the quantization step 
information 103 which is delivered to the quantizer (Q) 33 of 
the encoder 2. 
^ [0080] 

!j The quantization step controller 71 continually monitors 

ijlO the output buffer information 109 and, should there be produced 
j 2 overflow in the output buffer 40, the quantization step 
;\. information 103 is modified to diminish the code volume produced 
hj in the encoder 2 to prevent overflow from occurring in the output 
5 buffer 40. 
~15 [0081 ] 

Should there be produced or expected underflow in the 
output buffer 40, the quantization step information 103 is 
modified to increase the volume of codes produced in the encoder 
2 to prevent the underflow in the output buffer 40. This evades 
20 the output buffer 40 from being destroyed or running into fai lure 
or. 

[0082] 

It is also possible for the quantization step controller 
71 to set the target storage volume in the output buffer 40 to 
25 determine the quantization step information 103 based on the 
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relative magnitude of the output buffer information 109 as the 
actual storage volume and the target storage volume. 
[0083] 

If the actual storage volume is larger than the target 
5 storage volume, the quantization step information 103 is 

modified to decrease the volume of the codes generated in the 
encoder 2, that is for increasing the quantization step. 
[0084] 

I f , . conve rse I y, the storage volume is smaller than the 
;S0 target storage volume, the quantization step information 103 is 
m modified to increase the code volume generated in the encoder 

2, that is to decrease the quantization step. 
-* [0085] 

:i The target value can be variably set instead of being a 

t5 fixed value. It is also possible to set the upper and lower 

limit target values and to set the target value within a certain 

preset range. 

[0086] 

The quantization step controller 71 is able to calculate 
20 the code volume per processing unit from the input buffer 
information 107 and the output buffer information 109 in 
effecting picture coding system conversion. 
[0087] 

Now considering the processing unit based pre- and 
25 post-conversion code volumes in case of performing the picture 




encoding system conversion, if the p re-con ve r s i on code volume 
is larger than the post-conversion code volume, the band of the 
transmission channel t ransm i t t i ng- the bitstream would be not 
fully utilized. If, conversely, the post-conversion code 
5 volume is larger than the p re-con ve rs i on code volume, the 
bitstream cannot be sent with the band of the transmission 
channel sending out the bitstream, thus causing delay at the 
output buffer. 
[0088] 

rfl 0 That is, if the p r e-con ve r s i on code volume is coincident 

I with the post-conversion code volume, the most effective 

utilization of the band of the transmission channel and the time 
delay are reduced, provided, however, that this is applicable 
to a case where the band of the transmission channel for the input 
15 bitstream is the same as that of the transmission channel for 
the output b i ts t ream. 
[0089] 

If both the bands are different, the post-conversion code 
volume is preferably coincident with a p re-con ve rs i on code 
20 volume multiplied with a ratio R which is a ratio between the 
input transmission channel band and the output transmission 
channel band, e.g., a ratio R of the input band to the output 
band. 
[0090] 

25 Thus, with the quantization step controller 71, effective 
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utilization of the transmission channel and reduction in the 
time delay may be realized by determining the quantization step 
depending on the difference between the processing unit based 
pre-convers i on code volume and the post-conversion code volume 
5 in converting the picture encoding system. 
[0091 ] 

If, for example, the p re-con ve rs i on code volume is larger 
^ than the post-conversion code volume, the quantization step 
1 information 103 is modified (or modulated) to increase the code 
n1 0 volume generated in the encoder 2 at the next processing. 
3 [0092] 

If, conversely, the p re-convers i on code volume is less than 
] the post-conversion code volume, the quantization step 
I information 103 is modified (or modulated) to decrease the code 
15 volume generated in the encoder 2 at the next processing. 
[0093] 

In this manner, it becomes possible to determine the 
processing unit based quantization step in converting the 
picture encoding system. 
20 [0094] 

As a method for converting the picture encoding system, it 
is possible to use any of the quantization step modifying systems, 
such H. 261, H. 263, or MPEG 1, 2 or 4, which belong to the 
conventional picture encoding systems. 
25 [0095] 
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A second embodiment of the present invention is hereinafter 
explained. Fig. 2 shows the structure of the second embodiment. 
Referring to Fig. 2, the second embodiment of the present 
invention includes, in addition to the components of the first 
5 embodiment, a decoder monitor 51, owned by the transcoder 
controller 3, for monitoring the VLC unit 22. A quantization 
step controller 72 determines the quantization step information 
using the input buffer monitor 52, output buffer monitor 62 and 

5 the decoder monitor 51. 

Jjo [0096] 

Iq That is, referring to Fig. 2, the present second embodiment 

7 includes a decoder 1, an encoder 2 and a transcoder controller 
>± 3 . The decoder 1 is made up of an input buffer 21, a VLD unit 
2 22, an inverse-quantizer 23, anlDCTunit24, an adder 25, a frame 
¥5 memory 26 and a motion compensation prediction unit 27. The 
encoder 2 is made up of an adder 31, a DCT unit 32, a quantizer 
33, an inverse-quantizer 34, an I DCT unit 35, an adder 36, a frame 
memory unit 37, a motion compensation prediction unit 38, a VLC 
unit 39 and an output buffer 40. The a transcoder controller 
20 3 is made up of an input buffer monitor 52, an output buffer 
monitor 62 and a quantization step controller 72. 
[0097] 

Referring to Fig. 2, the operation of the second embodiment 
of the present invention is explained in detail. 
25 [0098] 



In addition to the operation of the above-described first 
embodiment, the operation of the decoding unit 1 includes the 
operation of the VLD unit 22 outputting encoding parameters 102 
to the decoder monitor 51 of the transcoder controller 3. The 
5 operation of the encoder 2 is similar to that of the previous 
first embod i men t . 
[0099] 

, H The operation of the transcoder controller 3 is now 

^ explained. 
mO [0100] 

j 5 The decoder monitor 51 monitors the VLD unit 22 of the 

;\. decoder 1 and outputs encoding parameters 108 to the 
[7! quantization step controller 72. 
q [0101] 

15 The input buffer monitor 52 monitors the stored input 

buffer volume in the input buffer 21 to output the input buffer 
information 107 to the quantization step controller 72. 
[0102] 

The output buffer monitor 62 monitors the stored output 
20 buffer volume in the output buffer 40 of the encoder 2 to output 
the output buffer information 109 to the quantization step 
controller 72. 
[0103] 

The transcoder controller 3 determines the quantization 
25 step information 103 based on the input buffer information 107 
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and the output buffer information 109 to deliver the so- 
determined information to the quantizer (Q) 33 of the encoder 
2. 

[0104] 

The transcoder controller 3 is also able to determine the 
quantization step information 103 by referencing also the 
encoding parameters 108. 
[0105] 

The quantization step controller 72 monitors the output 
buffer information 109, such that, if o ve r f I ow wou I d be produced 
in the output buffer 40, the quantization step controller 72 
causes the quantization step information 103 to decrease the 
code volume generated in the encoder 2 to prevent overflow from 
occurring in the output buffer 40. 
[0106] 

If underflow would be produced in the output buffer 40, the 
quantization step information 103 is modified to increase the 
volume of codes generated in the encoder 2 to prevent underflow 
of the output buffer 40. This prevents the output buffer 40 from 
f a i lure. 
[0107] 

It is possible for the quantization step controller 72 to 
set the target storage volume in the output buffer 40 to 
determine the quantization step information 103 based on the 
relative magnitudes between the output buffer information 109 
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as the actual storage volume and the target storage volume. 
[0108] 

If the actual storage volumewould become or is larger than 
the target storage volume, the quantization step information 103 
5 is modified to decrease the volume of the codes generated in the 
encoder 2, that is to increase (or enlarge) the quantization 
step. 
[0109] 

If, conversely, the actual storage volume is smaller than 
jrttO the target storage volume, the quantization step information 103 
is modified to increase the volume of the codes generated in the 
encoder 2, that is to decrease (or shorten) the quantization 
step. 
[0110] 

15 The target value can be variably set instead of being a 

fixed value. It is also possible to set the upper and lower 
limit target values and to set the target value within a certain 
preset range. 
[0111] 

20 The quantization step controller 72 calculates the code 

volume per processing unit based on the input buffer information 
107 and the output buffer information 109 in effecting picture 
coding system conversion. 
[0112] 

25 Now considering the processing unit based pre- and 



post-conversion code volumes in case of performing the picture 
encoding system conversion, if the p r e-conve rs i on code volume 
is larger than the post-conversion code volume, the band of the 
transmission channel transmitting the bitstream is not fully 
utilized. If, conversely, the p r e-conve rs i on code volume is 
smaller than the post-conversion code volume, the bitstream 
cannot be sent with the band of the transmission channel sending 
out the bitstream, thus causing delay at the output buffer. 
[0113] 

That is, if the p r e-conve rs i on code volume is coincident 
with the post-conversion code volume, the effective uti I ization 
of the band of the transmission channel is achieved, and time 
delay is reduced, provided, however, that this is appticable to 
a case where the band of the transmission channel for the input 
bitstream is the same as that of the transmission channel for 
the output b i tst ream. 
[0114] 

That is, if the bands would differ, the post-conversion 
code volume is desirably coincident with the pre-conversion code 
volume multiplied with a ratio R which is a ratio between the 
input transmission channel band and the output transmission 
channel band. 
[0115] 

In the transcoder controller 3, effective utilization of 
the transmission channel band and reduction in the delay time 
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can be realized by determining the Quantization step depending 
on the difference between the processing-unit-based pre- 
conversion code volume and the processing-unit-based post- 
conversion code volume as at the time of performing the picture 
encoding system conversion. 



For example, if the pre-conversion code volume would become 
or is larger than the post-conversion code volume, the 
quantization step information 103 is modified such as to 
increase the code volume generated in the encoder 2 at the time 
of the next processing. If, conversely, the pre-conversion code 
volumewould become or is smaller than the post-conversion code 
volume, the quantization step information 103 is modified such 
as to decrease the code volume generated in the encoder 2 at the 
time of the next processing. This allows to determine the 
quantization step per processing unit in converting the picture 
encod i ng sys tern. 



In the second embodiment of the present invention, the 
quantization step information 103 is determined (additionally) 
using the encoding parameters 108 output from the decoder 
monitor at the time of determining the quantization step. The 
reason is that, taking the picture quality following the 
conversion of the picture encoding system into consideration, 
the pre-conversion code volume can be equated to the post- 



[0116] 



[0117] 
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conversion code volume by performing the encoding using the 
quantization step obtained in the decoder 1 in performing the 
quantization in the encoder 2. 
[0118] 

5 If a quantization step used in decoding significantly 

differs from a quantization step used in encoding, picture 
distortion tends to be produced. 
[0119] 

!.] The picture quality can be improved by determining the 

IrtlO quantization step information 103 with the aid of the encoding 
| parameters 108 output from the decoder monitor 51. Control may 

be managed by performing fine adjustment, depending on the 
j output buffer 40, p r e~con v e r s i on code volume and on the 
3 post-conversion code volume, using the quantization step output 
15 from the decoder monitor 51 as an initial value. 
[0120] 

As the method for modifying the quantization step, use may 
be made of any of conventional picture encoding systems, such 
as the quantization step modifying systems, e.g., H. 261, H. 263, 
20 or MPEG1, 2 or 4. 
[0121] 

A third embodiment of the present invention is now 
explained. F i g. 3 shows the configuration of the third 
embodiment of the present invention. Referring to Fig. 3, the 
25 third embodiment of the present invention includes, in addition 



to the components of the first embodiment, a reception side 
transmission channel monitor ("reception channel monitor") 53 
for monitoring the reception side transmission channel and a 
sending out side transmission channel monitor 63 for monitoring 
5 the sending out side transmission channel, these monitors 53, 
63 being provided in the transcoder controller 3. The 
quantization step controller 73 determines the quantization 

, = . step information using the information output from the input 
buffer monitor 52, output buffer monitor 62, reception side 

nrij 0 transmission channel monitor 53 and from the sending out side 

m transmission channel monitor 63. 

_ [0122] 

H That is, referring to Fig. 3, the present third embodiment 

if? includes decoder 1, encoder 2 and transcoder controller 3. The 
"15 decoder 1 is made up of an input buffer 21, a VLD unit 22, an 
inverse-quantizer 23, an IDCT unit 24, an adder 25, a frame 
memory 26 and a motion compensation prediction unit 27. The 
encoder 2 is made up of an adder 31, a DCT unit 32, a quantizer 
33, an inverse-quantizer 34, a n I DCT unit 35, an adder 36, a frame 
20 memory unit 37, a motion compensation prediction unit 38, a VLC 
unit 39 and an output buffer 40. The transcoder controller 3 
is made up of an input buffer monitor 52, a reception side 
transmission channel monitor 53, an output buffer monitor 62, 
a sending out side transmission channel monitor 63, and a 
25 quantization step controller 73. 
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[0123] 

Referring to Fig. 3, the operation of the third embodiment 
of the present invention is explained in detail. 
[0124] 

5 The description for the operation of the decoder 1 and the 

encoder 2 is omitted because it is the same as that of the 
above-described first embodiment. 

The operation of the transcoder controller 3 is now explained. 
3 [012 5] 

iVO The reception side transmission channel monitor 53 

111! monitors the state of the transmission channel over which the 
input bitstream is transmitted to output the sending out side 
U reception channel information 111 to the quantization step 
□ controller 73. 
135 [012 6] 

The sending out side transmission channel monitor 63 
monitors the state of the transmission channel over which the 
output bitstream is transmitted to output the sending out side 
transmission channel information 112 to the quantization step 
20 con t ro I I er 73. 
[0127] 

The input buffer monitor 52 monitors the storage volume of 
the input buffer 21 of the decoder 1 to output the sending out 
side transmission channel information 112 to the quantization 
25 step controller 73. 



[0128] 

The output buffer monitor 62 monitors the storage volume 
of the output buffer 40 of the encoder 2 to output the output 
buffer information 109 to the quantization step controller 73. 
5 [0129] 

The transcoder controller 3 determines the quantization 
step information 103, based on the input buffer information 107 
- and the output buffer information 109, to deliver the resulting 
j quantization step information 103 to the quantizer 33 of the 
il 0 encoder 2. 
J [0130] 

The reception side transmission channel information 111 
and the sending out side transmission channel information 112 
may also be referenced in determining the quantization step 
15 information 103. 
[0131] 

The quantization step controller 73 monitors the output 
buffer information 109, such that, if overflow would occur in 
the output buffer 40, the quantization step information 103 is 
20 modified to reduce the volume of the codes generated in the 
encoder 2 to prevent overflow from occurring in the output buffer 
40. 

[0132] 

On the other hand, if underflow would occur in the output 
25 buffer 40, the quantization step information 103 is modified to 




increase the volume of the codes generated in the encoder 2 to 
prevent underflow from occurring in the output buffer 40. 
[0133] 

This prevents the failure in operation from occurring in 
5 the output buffer 40. 
[0134] 

It is also possible for the quantization step controller 
n 73 to set the target storage volume in the output buffer 40 to 
y determine the quantization step information 103 from the 
urflO relative magnitude of the output buffer information 109 as the 
j ^ actual storage volume and the target storage volume. 

^ tons] 

j iL j If the actual storage volume is larger than the target 

13 storage volume, the quantization step information 103 is 
15 modified to decrease the volume of the codes generated in the 
encoder 2. 
[0136] 

That is, adjustment is made for increasing the quantization 

s t ep. 
20 [0137] 

If, conversely, the storage volume is smaller than the 
target storage volume, the quantization step information 103 is 
modified to increase the code volume generated in the encoder 
2. 

25 [0138] 



That is, adjustment is made for decreasing the quantization 

s tep. 
[01393 

The target value can be variably set instead of being a 
f i xed value. 
[0140] 

It is also possible to set the upper and lower limit target 
values and to set the target value within a certain preset range. 
[0141] 

The quantization step controller 73 calculates the code 
volume per processing unit (i.e., unit by unit) based on the 
input buffer information 107 and the output buffer information 
109 in effecting picture coding system conversion. 
[0142] 

Now, considering the processing-unit-based pre- and 
post-conversion code volumes in case of performing the picture 
encoding system conversion, if the p re-con ve rs i on code volume 
would become larger than the post-conversion code volume, the 
band of the transmission channel transmitting the bitstream is 
not fully un i I i zed. 
[0143] 

If, conversely, the p re-con ve rs i on code volume is smaller 
than the post-conversion code volume, the bitstream cannot be 
sent with the band of the transmission channel sending out the 
bitstream, thus causing delay at the output buffer. 
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[0144] 

That is, if the pre-convers i on code volume is coincident 
with the post-conversion code volume, the most effective 
utilization of the band of the transmission channel and reduced 
5 time delay can be achieved. 
[0145] 

The premise for this is that this is that the band of the 
transmission channel for the input bitstream is controlled to 
;1 be the same as that of the transmission channel for the output 
unl 0 b i t s t ream. 
m [0146] 

That is, if the both bands would differ, the post- 
Q conversion code volume is desirably coincident with the pre- 
□ conversion code volume multiplied with a ratio R between the 
15 input transmission channel band and the output transmission 
channel band. 
[0147] 

The ratio R between the input transmission channel band and 
the output transmission channel band can be calculated from the 
20 reception side transmission channel information 111 and the 
sending out side transmission channel information 112. 
[0148] 

If both the input transmission channel and the output 
transmission channel are at the CBR (constant bit rate), that 
25 is the fixed transmission rate, the ratio R is constant, whereas, 



if one of them is at VBR (variable bit rate), that is at a variable 

transmission rate, the ratio R is variable. 

[0149] 

So, in the quantization step controller 73, effective 
utilization of the transmission channel band and reduction in 
the delay time can be realized by determining the quantization 
step depending on the difference between the processing- 
unit-based pre-conve r s i on code volume and the processing- 
unit-based post-conversion code volume as at the time of 
performing the picture encoding system conversion. 
[0150] 

For example, if the pre-conve rs i on code volume is larger 
than the post-conversion code volume, the quantization step 
information 103 is modified such as to increase the code volume 
generated in the encoder 2 at the time of the next processing. 
[0151] 

If, conversely, the p re-con ve rs i on code volume is smaller 
than the post-conversion code volume, the quantization step 
information 103 is modified such as to decrease the code volume 
generated in the encoder 2 at the time of the next processing. 
[0152] 

This allows to determine the quantization step per 
processing unit in converting the picture encoding system. 
[0153] 

If the transmission channel is at the VBR, and there is 
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certain allowance in the band of the transmission channel, the 
volume of the codes generated in the encoder 2 may be increased 
to achieve the effective band utilization. 
[0154] 

5 If, conversely, there is no allowance in the band of the 

transmission channel, the quantization step information 103 is 
determined such as to decrease the volume of the codes generated 
in the encode r 3. 
1 [0155] 

:J0 As the method for modifying the quantization step, use may 

t~ be made of any of the conventional picture encoding systems, such 
r as the quantization step modifying systems, e.g., H. 261, H. 263, 

or MPEG1, 2 or 4. 
3 [0156] 

?5 A fourth embodiment of the present invention is now 

explained. F i g. 4 shows the configuration of the fourth 
embodiment of the present invention. Referring to Fig. 4, the 
fourth embodiment of the present invention includes, in addition 
to the components of the first embodiment, a decoder monitor 51 

20 for monitoring the reception side transmission channel, a 

reception side transmission channel monitor 53 for monitoring 
the reception side transmission channel and a sending out side 
transmission channel monitor 63 for monitoring the sending out 
side transmission channel, these monitors 51, 53 and 63 

25 belonging to the transcoder controller 3. A quantization step 




- . controller 73 determines the quantization step information 
using the information output by the input buffer monitor 52, 
output buffer monitor 62, decoder monitor 51, reception side 
transmission channel monitor 53 and the sending out side 
5 transmission channel monitor 63. 
[0157] 

That is, referring to F i g. 4, the present third embodiment 
includes decoder 1, encoder 2 and transcoder 3. The decoder 1 
;H is made up of an input buffer 21, a VLD unit 22, an inverse- 
Ifj1 0 quantizer 23, an IDCT unit 24, an adder 25, a frame memory 26 
!]y and a motion compensation prediction unit 27. The encoder 2 is 

made up of an adder 31, a DCT unit 32, a quantizer 33, an 
^ inverse-quantizer 34, an IDCT unit 35, an adder 36, a frame 

memory unit 37, a motion compensation prediction unit 38, aVLC 
"15 unit 39 and an output buffer 40. The transcoder controller 3 
is made up of a decoder monitor 51, an input buffer monitor 52, 
a reception side transmission channel monitor 53, a sending out 
side transmission channel monitor 63, an output buffer monitor 
62 and a quantization step controller 74. 
20 [0158] 

Since the operation of the decoder 1 is the same as that 
of the second embodiment, while the operation of the encoder 2 
is the same as that of the first embodiment, the corresponding 
explanation is omitted for simplicity. 
25 [0159] 



The operation of the transcoder controller 3 is now 
exp I a i ned. 
[0160] 

The reception side transmission channel monitor 53 
5 monitors the state of the transmission channel over which the 
input bitstream is transmitted to output the reception side 
transmission channel information 111 to the quantization step 
controller 74. 

:jj [0161] 

j sft 0 The sending out side transmission channel monitor 63 

m monitors the state of the transmission channel over which the 
output bitstream is transmitted to output the sending out side 
['.I transmission channel information 112 to the quantization step 
j;5 controller 74. 
"15 [0162] 

The decoder monitor 51 monitors the VLD unit 22 of the 
decoder 1 to output the encoding parameters 108 to the 
quantization step controller 72. 
[0163] 

20 The input buffer monitor 52 monitors the storage volume of 

the input buffer 21 of the decoder 1 to output the input buffer 
information 107 to the quantization step controller 74. 
[0164] 

The output buffer monitor 62 monitors the storage volume 
25 of the output buffer 40 of the encoder 2 to output the output 



buffer information 109 to the quantization step controller 74. 
[0165] . 

The transcoder controller 3 determines the quantization 
step information 103, primarily based on the input buffer 
5 information 107 and the output buffer information 109, to 
deliver the resulting quantization step information 103 to the 
quantizer (Q) 33 of the encoder 2. 
[0166] 

^ The reception side transmission channel information 111 

'if 

AO and the sending out side transmission channel information 112 
jo may also be referenced in determining the quantization step 

i n format ion 103. 
j [0167] 

:i The quantization step controller 74 monitors the output 

is buffer information 109, such that, if overflow occurs in the 
output buffer 40, the quantization step information 103 is 
modified to reduce the volume of the codes generated in the 
encoder 2 to prevent overflow from occurring in the output buffer 
40. 

20 [0168] 

On the other hand, if underflow occurs in the output buffer 
40, the quantization step information 103 is modified to 
increase the volume of the codes generated in the encoder 2 to 
prevent underflow from occurring in the output buffer 40. 
25 [0169] 



This prevents the failure in operation from occurring in 
the output buffer 40. 
[0170] 

It is also possible for the quantization step controller 
5 74 to set the target storage volume in the output buffer 40 to 
determine the quantization step information 103 from the 
relative magnitude of the output buffer information 109 as the 
actual storage volume and the target storage volume. 
3 [0171] 

jM) If the actual storage volume is larger than the target 

;^ storage volume, the quantization step information 103 is 

~ modified such as to decrease the volume of the codes generated 

in the encoder 2. 
□ [0172] 

If, conversely, the storage volume is smaller than the 
target storage volume, the quantization step information 103 is 
modified such as to increase the code volume generated in the 
encoder 2. 
[0173] 

20 The target value can be variably set instead of being a 

fixed value. 
[0174] 

It is also possible to set the upper and lower limit target 
values and to set the target value within a certain preset range. 
25 [0175] 



# 
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The quantization step controller 74 is able to calculate 
the code volume per processing unit based on the input buffer 
information 107 and the output buffer information 109 in 
effecting picture coding system conversion. 



Now let's consider the processing-unit-based pre- and 
post-conversion code volumes in case of performing the picture 
encoding system conversion. If the p re-con ve rs i on code volume 
would become larger than the post-conversion code volume, the 
band of the transmission channel transmitting the bitstream 
would be not fully utilized. 



If, conversely, the p r e-con ve r s i on code volume is smaller 
than the post-conversion code volume, the bitstream cannot be 
sent with the band of the transmission channel sending out the 
bitstream, thus causing delay at the output buffer. 
[01783 

That is, if the p re-con ve rs i on code volume is coincident 
with the post-conversion code volume, the most effective 
utilization of the band of the transmission channel and reduced 
time delay can be achieved. 
[0179] 

The premise for this is that this is that the band of the 
transmission channel for the input bitstream is the same as that 
of the transmission channel for the output bitstream. 



[0176] 



[0177] 




[0180] 

That is, if both the bands differ, the post-conversion code 
volume should be desirably coincident with the p r e-convers i on 
code volume multiplied with a ratio R between the input 
5 transmission channel band and the output transmission channel 
band. 
[0181] 

The ratio R between the input transmission channel band and 
^ the output transmission channel band can be calculated from the 
n3 0 reception side transmission channel information 111 and the 
m sending out side transmission channel information 112. 
[0182] 

;^ If both the input transmission channel and the output 

:;| transmission channel are at the CBR (constant bit rate), that 
i 5 is the fixed transmission rate, the ratio R is constant, whereas, 

if oneof them is at VBR (variable bit rate), that is at a variable 

transmission rate, the ratio R is variable. 

[0183] 

In the quantization step controller 74, effective 
20 utilization of the transmission channel band and reduction in 
the delay time can be realized by determining the quantization 
step depending on the difference between the processing- 
unit-based p r e-conve r s i on code volume and the processing- 
unit-based post-conversion code volume as at the time of 
25 performing the picture encoding system conversion. 



[0184] 

For example, if the p re-con ve rs i on code volume is larger 
than the post-conversion code volume, the quantization step 
information 103 is modified such as to increase the code volume 
5 generated in the encoder 2 at the time of the next processing. 
[0185] 

If, conversely, the pre-convers i on code volume is smaller 
than the post-conversion code volume, the quantization step 
9 information 103 is modified such as to decrease the code volume 
•jjo generated in the encoder 2 at the time of the next processing. 
| [0186] 

This allows to determine the quantization step per 
processing unit in converting the picture encoding system. 
3 [0187] 

: ?5 If the transmission channel is at the VBR, and there is 

certain allowance in the band of the transmission channel, the 
volume of the codes generated in the encoder 2 may be increased 
to achieve the effective band utilization. 
[0188] 

20 If, conversely, there is no allowance in the band of the 

transmission channel, the quantization step information 103 is 
determined such as to decrease the volume of the codes generated 
in the encoder 3. 
[0189] 

25 The quantization step information 103 may also be 



determined using the encoding parameters 108 output from the 
decoder monitor in determining the quantization step. 
[0190] 

The reason is that, taking the picture quality following 
5 the conversion of the picture encoding system, the pre- 
conversion picture properties can be equated to the post- 
conversion picture properties by performing the encoding using 
the quantization step obtained in the decoder 1 in performing 
!j the quantization in the encoder 2. 
!SlO [0191] 

j 13 If the quantization step used in decoding significantly 

■■^ differs from the quantization step used in encoding, picture 

distortion tends to be produced. 
H [0192] 

15 The picture quality can be improved by determining the 

quantization step information 103 with the aid of the encoding 
parameters 108 output from the decoder monitor 51. 
[0193] 

That is, control may be managed by performing fine 
20 adjustment, depending on the output buffer 40, pre-convers i on 
code volume and on the post-conversion code volume, using the 
quantization step output from the decoder monitor as an initial 
value. 
[0194] 

25 As the method for modifying the quantization step, use may 



be made of any of the conventional picture encoding systems, such 
as the quantization step modifying systems, e. g. , H. 261, H. 263, 
or MPEG 1 , 2 or 4. 
[0195] 

5 Fig. 9 is a flow diagram showing a typical operation of the 

quantization step controller 74 in the fourth embodiment of the 
p r esen t invention. 
[0196] 

13 At step A 1 , the quantization step is provisionally 

■y0 determined by the decoder operation information 102. 
5 * [0197] 

r At step A2, the target code (generation) volume is set from 

the input buffer information 107 based on the pre-conversion 
□ code volume per encoding system conversion processing unit. 
-15 [0198] 

At step A3, it is verified whether or not the stored volume 
of the output buffer is within the target range. If the stored 
volume is within the target range, the quantization step 
controller 74 proceeds to step A4. 
20 [0199] 

If the storage volume of the output buffer is verified at 
step A3 to be outside the target range, the quantization step 
controller 74 proceeds to step B1 top B4, depending on the 
storage volume. 
25 [0200] 




At step A4, the quantization step Q is changed (modified) 
depending on the target code volume. 
[0201] 

The quantization step information 103 is output at this 
5 time to the quantizer 33 of the encoder 2. 
[0202] 

At step A5, the encoder 2 performs encoding using the 
quantization step information 103 mentioned above. 
;j3 [0203] 

Jp1 0 At step A6, the volume of the actually produced codes is 

m determined from the output buffer information 109 to update the 

target code volume of the generated codes. 
|* [0204] 

If, at step A7, the end condition is not met, theprocessing 
~]5 reverts to step A1 making up a loop. 
[0205] 

If, at step A3, the storage volume of the output buffer is 
outside the target range (NO), processing branches to step B1 
(overflow), step B2 (the storage volume being larger than the 

20 lower target value), step B3 (the storage volume being smaller 
than the upper target value) or to step B4 (underflow), depending 
on the stored volume of the output buffer. At steps B1 and B2, 
the processing transfers to step C1 to increase the quantization 
step Q, whereas, at steps B3 and B4, the processing transfers 

25 to step C2 to decrease the quantization step Q before 



t ransf er r i ng to step A5. 
[0206] 

A fifth embodiment of the present invention is hereinafter 
explained. F i g. 5 shows the configuration of a code rate 
5 conversion device according to the fifth embodiment of the 
present i nven t i on. 
[0207] 

Referring to Fig. 5, the fifth embodiment of the present 
invention includes a code rate conversion device 4 and a 

10 transcoder controller 3. The code rate conversion device 4 is 
made up of an input buffer 21, a variable length decoding (VLD) 
unit 22, an inverse-quantizer (IQ) 84, an adder 85, an inverse 
discrete cosine transform (IDCT) unit 86, a frame memory 87, a 
difference calculating unit (ADDER) 88 and a discrete cosine 

15 transform (DCT) unit 89. The transcoder controller 3 is made 
up of an input buffer monitor 52, an output buffer monitor 62 
and a quantization step controller 71. 
[0208] 

Referring to Fig. 5, the operation of the code rate 
20 conversion device, according to the fifth embodiment of the 
present invention, is explained in detail. 
[0209] 

First, the operation of a code rate conversion device 5 is 
explained. 
25 [0210] 



The input buffer 21 stores the bitstream, supplied thereto 
from outside, to output the stored bitstream to the VLD unit 22. 
[021 1] 

On the other hand, the input buffer monitor 52 is fed with 
5 the input buffer storage information 101. 
[0212] 

The VLD unit 22 performs entropy decoding, such as variable 
length decoding or run-length decoding, on the bitstream output 
:fl from the input buffer 21, to output decoded quantization 
MB transform coefficients to the inverse-quantizer (IQ) 23. 
;jj [0213] 

^ The encoding parameters 201, such as the motion vector or 

\*h the prediction mode, are sent to the difference calculating unit 
O 88 and to the VLC un i t 83. 
IS [0214] 

The inverse-quantizer 23 inverse-quantizes the quantized 
transform coefficients output from the VLD unit 22 to output the 
inverse-quantized transform coefficients. 
[0215] 

20 The IDCT unit 24 performs IDCT matrix processing 

(calculations) coefficients on the transform coefficients 
output from the IQ unit 23 to output the transformed picture 
s i gna Is to the adder 81 . 
[0216] 

25 The adder 81 sums the signal output from the inverse- 
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quantizer 23 and an output of the DCT unit 89 to output a 
resulting sum to the quantizer (Q) 82 and to the adder 85. 
[0217] 

The quantizer 82 quantizes the transform coefficients 
5 output from the adder 81 to output resulting quantized transform 
coefficients to the VLC unit 83 and to the inverse-quantizer (IQ) 
84. 

[0218] 

Q The VLC unit 83 performs entropy decoding, such as variable 

:|0 length decoding or run-length decoding, on the quantized 

transform coefficients output from the quantizer 82, and on the 
7 encoding parameters 201, output from the VLD unit 22, to output 
^ the resulting encoded signals to the output buffer 40. 
3 [0219] 

H5 The inverse-quantizer (IQ) 84 inverse-quantizes the 

quantized transform coefficients, output from the quantizer 82, 
to output the resulting transform coefficients to the adder 85. 
[0220] 

The adder 85 sums the transform coefficients, output from 
20 the inverse-quantizer 84, and the transform coefficients output 
from the adder 81, more specifically, negative values thereof, 
to output a resulting sum to the IDCT unit 86. 
[0221] 

The IDCT 86 performs IDCT matrix calculations on the 
25 transform coefficients output from the adder 85 to output 



resulting picture signals to the frame memory 87. 
[0222] 

The frame memory 87 stores the picture signals output from 
the IDCT unit 86. 
5 [0223] 

The difference calculating unit (ADDER) 88 calculates the 
difference between a picture one frame before and the current 
picture to output the resulting difference to the DCT unit 89. 
[0224] 

;Sl 0 The DCT unit 89 performs DCT matrix calculations on the 

5q difference data output from the difference calculating unit 88 
to output the resulting transform coefficients to the adder 81. 
* [0225] 

The output buffer 40 stores the encoded signals, output 
;= 1 5 from the VLC unit 83, to send out the encoded signals to outside 
the device. 
[0226] 

The operation of the transcoder controller 3, having an 
input buffer monitor 52, an output buffer monitor 62 and a 
20 quantization step control ler 71, and configured for control I ing 
the quantization step of the quantizer 82 by the quantization 
step controller 71, is similar to that of the above-described 
first embodiment and hence is not explained specifically. 
[0227] 

25 A sixth embodiment of the present invention is now 



explained. Fig. 6 shows the structure of a code rate conversion 
device according to the sixth embodiment of the present 
invention. Referring to Fig. 6, the present sixth embodiment of 
the present invention includes, in addition to the structure of 
5 the above-described fifth embodiment, a decoder monitor 51, 
owned by the transcoder control ler 3, for monitoring the VLD unit 
22, with the quantization step controller 72 determining the 
quantization step information using the information output from 
=0 the input buffer monitor 52, output buffer monitor 62 and decoder 
ivJO monitor 51. That is, the sixth embodiment of the present 
=P invention includes a code rate conversion device 4 and a 
;y transcoder controller 3. The code rate conversion device 4 is 
made up of an input buffer 21, a VLD unit 22, an inverse-quantizer 
;| (IQ) 23, an adder 81, a quantizer 82, a VLC unit 83, an 
ifis inverse-quantizer ( I Q) 84, an adder 85, an IDCT unit 86, a frame 
memory 87, a difference calculating unit 88 and a DCT unit 89. 
The transcoder controller 3 is made up of a decoder monitor 51, 
an input buffer monitor 52, an output buffer monitor 62 and a 
quantization step controller 73. 
20 [0228] 

The operation of the code rate conversion device 4 is the 
operation of the fifth embodiment plus the operation of the VLD 
unit 22 outputting the encoding parameters 102 to the decoder 
monitor 51 of the transcoder controller 3. 
25 [0229] 



The operation of the transcoder controller 3 is similar to 
that of the transcoder controller 3 in the above-described 
second embodiment and hence is not explained specifically. 
[0230] 

A seventh embodiment of the present invention is now 
explained. F i g. 7 shows the structure of the code rate 
conversion device according to the seventh embodiment of the 
present invention. Referring to Fig. 7, the present seventh 
embodiment of the present invention includes, in addition to the 
structure of the above-described fifth embodiment, a reception 
side transmission channel monitor 53 for monitoring the 
reception side transmission channel, and a sending out side 
transmission channel monitor 63 for monitoring the sending 
transmission channel, both owned by the transcoder controller 
3, with the quantization step controller 73 determining the 
quantization step information using the information output from 
the input buffer monitor 52, output buffer monitor 62, reception 
side transmission channel monitor 53 and the sending out side 
transmission channel monitor 63. That is, the sixth embodiment 
of the present invention includes a code rate conversion device 
4 and a transcoder controller 3. The code rate conversion 
device 4 is made up of an input buffer 21, a VLD unit 22, an 
inverse-quantizer (IQ) 23, an adder 81, a quantizer 82, a VLC 
unit 83, an inverse-quantizer (IQ) 84, an adder 85, an IDCT unit 
86, a frame memory 87, a difference calculating unit 88 and a 



DCT unit 89 The a transcoder control ler 3 is made up of an input 
buffer monitor 52, a reception side transmission channel monitor 
53, an output buffer monitor 62, a sending out side transmission 
channel monitor 63, and a quantization step controller 73. 
[0231 ] 

The operation of the code rate conversion device 4 and the 
operation of the transcoder controller 3 are similar to those 
of the code rate conversion device 5 in the previous fifth 
embodiment, and the transcoder controller 3 in the previous 
third embodiment, respectively, and hence are not explained 
specifical ly. 
[0232] 

An eighth embodiment of the present invention is now 
explained. F i g. 8 shows the structure of the code rate 
conversion device according to the eighth embodiment of the 
present invention. Referring to Fig. 8, the present eighth 
embodiment of the present invention includes, in addition to the 
structure of the above-described fifth embodiment, a decoder 
monitor 51 for monitoring the VLD unit 22, a reception side 
transmission channel monitor 53 for monitoring the reception 
side transmission channel, and a sending out side transmission 
channel monitor 63 for monitoring the sending transmission 
channel, these monitors 51, 53 and 63 being owned by the 
transcoder controller 3. The quantization step controller 73 
determines the quantization step information using the 




information output from the input buffer monitor 52, output 
buffer monitor 62, reception side transmission channel monitor 
53, decoder monitor 51 and the sending out side transmission 
channel monitor 63. That is, the present eighth embodiment of 
the present invention includes a code rate conversion device 4 
and a transcoder controller 3. The code rate conversion device 
4 is made up of an input buffer 21, a VLD unit 22, an 
inverse-quantizer ( I Q) 23, an adder 81, a quantizer 82, a VLC 
unit 83, an inverse-quantizer (IQ) 84, an adder 85, an IDCT unit 
86, a frame memory 87, a difference calculating unit 88 and a 
DCT unit 89. The transcoder controller 3 is made up of an input 
buffer monitor 52, a reception side transmission channel monitor 
53, an output buffer monitor 62, a sending out side transmission 
channel monitor 63, and a quantization step controller 73. 
[0233] 

The operation of the code rate conversion device 4 and the 
operation of the transcoder controller 3 are similar to those 
of the code rate conversion device 5 in the previous sixth 
embodiment and the transcoder controller 3 in the previous 
fourth embodiment, respectively, and hence are not explained 
spec i f i ca I ly. 
[0234] 

The meritorious effects of the present invention 
are summarized as follows. 

As described above, the present invention gives the 



following meritorious effects: 
[0235] 

The first effect of the present invention is that, since 
the time delay can be diminished, it is possible to realize 
encoding system conversion and code rate conversion suited to 
real-time communication. 
[0236] 

The second effect is that, since the quantization may be 
achieved by feedback of the p r e-conve r s i on and post-conversion 
code volumes, the transmission channel band can be uti I ized most 
effectively, and the time delay produced in conversion can be 
diminished. 
[0237] 

The third effect is that control is managed not only from 
the encoding parameters obtained after VLD, but also from the 
input buffer, output buffer and code volume etc., and hence a 
more flexible conversion may be achieved. 

It should be noted that other objects, features and aspects 
of the present invention will become apparent in the entire 
disclosure and that modifications may be done without departing 
the gist and scope of the present invention as disclosed herein 
and claimed as appended herewith. 

Also it should be noted that any combination of the 
disclosed and/or claimed elements, matters and/or items may fal I 
under the modifications aforementioned. 



